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Abstract 

Training  in  flight  .^iinnlators  will  be  more 
effect  ire  if  the  agents  involved  in  the  sim¬ 
ulation  behave  nalisticallg.  Accomplishing 
this  requires  that  the.  automated  agents  be 
under  autonomous,  intelligent  control.  We 
are  using  the  .Soar  ceignitive  architecture  to 
implement  intelligent  agents  that  behave  as 
much  like  humans  as  possible.  In  order 
to  approximate  human  behavior,  the  agents 
mu.st  integrate  planning  and  reaction  in  real 
time,  adapt  to  new  and  unexpected  situ¬ 
ations.  learn  with  experience,  and  exhibit 
the  cognitive  limitations  and  strengths  of 
humans.  This  paper  describes  two  simple 
tactical  flight  sce  narios  and  the  knowledge 
required  for  an  agent  to  complete  them.  In 
addition,  the  pope  r  de scribes  an  implemented 
agent  model  that  performs  in  limited  tacti¬ 
cal  scenarios  on  three  different  flight  sim¬ 
ulators. 

The  goal  of  this  research  is  to  construct 
intelligent,  automated  agents  for  flight  sim- 
idators  that  are  ust'd  to  train  navy  pilots 
in  flight  tactics.  \\  hen  pilots  train  in  tacti¬ 
cal  simulations,  they  learn  to  react  to  (and 
rea.son  about)  the  behaviors  of  the  otlmr 


agents  (friendly  and  enemy  forces)  in  the 
training  scenario.  Thus,  it  is  important 
that  these  agents  behave  as  realistically  as 
possible.  Standard  automated  and  semi- 
automated  agents  can  provide  this  to  a  lim¬ 
ited  extent,  but  trainees  can  quickly  rec¬ 
ognize  automated  agents  and  take  advan¬ 
tages  of  known  weaknesses  in  their  behav¬ 
ior.  To  provide  a  more  realistic  training  sit¬ 
uation.  automated  agents  should  be  indis¬ 
tinguishable  from  other  human  pilots  tak¬ 
ing  part  in  the  simulation. 

To  construct  such  intelligent,  automated 
agents,  we  have  applied  techniques  from 
the  fields  of  artificial  intelligence  and  cog¬ 
nitive  science.  The  agents  are  implemented 
within  the  Soar  system,  a  state-of-the-art. 
integrated  cognitive  architecture  (Rosen- 
bloom  et  ah,  1991).  These  agents  incor¬ 
porate  knowledge  gleaned  from  interviews 
with  experts  in  flight  tactics  and  analysis 
of  the  tactical  domain.  Soar  is  a  promising 
candidate  for  developing  agents  that  be¬ 
have  like  humans.  Flexible  and  adaptive 
behavior  is  one  of  Soar’s  primary  strengths, 
and  Soar's  learning  mechanism  provides  it 
with  the  capability  of  improving  its  perfor¬ 
mance  with  experience.  In  addition.  Soar 
allows  the  smooth  integration  of  planning 
and  reaction  in  decision  making  (Pearson 


<'t  al.  1!)!).'5).  l  iiially.  Soar  is  tlu'  Ibiindat ion 
for  the  dcvolopnu’iil  of  a  jjroixisod  niiilit'd 
tlu'orv  of  human  cognition  (Xeuadl,  1  !)*)()). 
and  thus  maps  quite  well  onto  a  number  of 
the  cognitive  issues  of  interest.  This  paper 
reports  the  results  of  our  research  in  con¬ 
structing  an  int('llig('nt  agent  for  an  initial, 
sim])le  training  scenario  and  our  (dforts  at 
supplemer  mg  t  he  agent 's  knowledge  in  or¬ 
der  to  carry  out  mort'  comple.x  missions. 

Complexities  of  tactical  decision¬ 
making 

In  order  to  complete  a  tactical  mission, 
pilots  incorporate  multiple  types  of  knowl¬ 
edge.  These  include,  for  example,  knowl¬ 
edge  about  the  goals  of  the  mission,  air¬ 
plane  and  weapon  constraints,  survival  tac¬ 
tics.  controlling  the  vehicle,  characteristics 
of  the  environment,  and  the  physical  and 
cognitive  capabilities  of  all  of  the  agents 
taking  part  in  the  scenario.  In  addition, 
pilots  use  their  knowh'dge  flexibly  and  ex¬ 
hibit  adaptive  behavior.  This  includes  a 
variety  of  capabilities,  such  as  reasoning 
about  (and  surviving  in)  unexpected  sit¬ 
uations.  adapting  to  new  situations,  learn¬ 
ing  from  <’xperience,  and  addressing  multi¬ 
ple  goals  simultaneously  (e.g.,  protecting  a 
position,  intercepting  the  enemy,  and  sur¬ 
viving).  I'inally.  pilots  integrate  decision¬ 
making  during  a  mission  with  split-second 
reactions  to  new  situations  and  potential 
t  hrf'ats. 

Hobust  automated  forces  that  can  carry 
out  general  simulated  missions  must  ad- 
dr«’ss  these  issues,  especially  if  the  forces 
are  to  Ixdiave  as  humans  would  in  simi¬ 
lar  circumstances.  In  addition  to  provid¬ 
ing  the  wide  range  of  capabilities  that  hu¬ 
man  [)ilots  exhil)it.  intelligent  agents  must 


reflect  the  same  type's  of  weakiu'sses  as  hu 
mans.  These  include'  mental  limitations, 
such  as  attention  and  cognitive  load,  and 
|)hysical  limitations,  such  as  re'duce'd  cog¬ 
nitive  processing  under  high  forces  (such 
as  during  a  hard  turn). 

To  capture  the  complex  interactions  be¬ 
tween  agents  in  a  simulation,  we  feel  it  nec- 
es.sary  for  each  agent  to  be  as  autonomous 
and  intelligent  as  possible.  .Simulation  via 
stochastic  methods  can  capture  general  be¬ 
haviors  of  groups  of  agents,  but  a  more  re¬ 
alistic  simulation  requires  each  agent  to  be¬ 
have  individually,  with  is  own  set  of  goals, 
constraints,  and  perceptions.  In  addition, 
if  the  agents  are  to  be  used  for  training  pi¬ 
lots.  they  must  be  intelligent  in  order  to 
provide  as  rich  a  training  environment  as 
would  flying  against  real  humans. 

Requirements  for  an  intelligent  au¬ 
tomated  agent 

The  primary  research  question  is  how  in¬ 
telligent.  automated  agents  should  be  im¬ 
plemented.  .A  simple  solution  would  be 
to  attempt  to  create  “simulation-pilot  ex¬ 
pert  systems'.  This  would  involve  con¬ 
verting  knowledge  about  high-level  tacti¬ 
cal  decision-making  into  a  fixed  rule  base. 
The  system  would  suggest  the  most  appro¬ 
priate  action  (or  set  of  actions)  based  on 
the  current  status  of  the  environment.  In 
fact,  a  number  of  expert  systems  have  been 
implemented  for  various  aspects  of  tactical 
decision-making  (e.g.,  Kornell,  1987;  Rit¬ 
ter  Sc  Feurzeig,  1987;  Zytkow  Sc  Erickson. 
1987;  ). 

However,  while  expert  systems  have  some 
of  the  strengths  required  for  realistic  sim¬ 
ulation.  they  are  usually  weak  in  other  ar¬ 
eas.  In  a  standard  rule-based  approach,  it 


is  (liflicult  to  cai)!  tire  t  li(>  complrxil y  of  t  lie 
mtilti|)l('.  (lyiininic  go;ils  that  pilots  must 
reason  aljout.  Iti  cotitrast.  systettis  that 
can  reasoti  \v(’ll  iti  such  a  cotiiph'X  dotuain 
getierally  have  (liflicult i('s  making  decisions 
in  rt'al  time,  atid  t  h('y  often  do  not  have' 
the  al)ility  to  react  to  chatiges  in  the  (ui- 
virotiment  wheti  there-  is  not  enough  time 
to  plan  ahead.  In  addition,  systems  with 
otily  high-level  tactical  ktiowh-dge  [)rov<'  to 
he  rather  rigifl.  I’nless  the  syst('tn  cati 
be  preprogratntm-d  for  every  possible  con¬ 
tingency.  its  perfortnance  degraeh-s  greatly 
when  it  fitids  itself  iti  utiexpected  situa¬ 
tions.  Finally,  exju-rt  systetns  getierally  ig¬ 
nore  the  possibility  of  leartiing  with  ex[)('- 
rience  and  other  cognitive  aspects  of  the 
task.  Intelligetit .  autotiomous  agetits  must 
combine  all  of  tln-se  stretigths.  having  the 
ability  to  reasoti  about  tmiltiple  goals  in 
a  cotnplex  envirotiitietit.  react  quickly  and 
appropriately  wln-ti  the  time  for  complex 
rea.soning  is  litnit<’d.  adapt  to  tiew  situa- 
tiotis  gracefully,  atid  itnprove  its  behavior 
with  experience. 

In  order  to  create  ati  agetit  that  can  rea¬ 
son  atid  react  iti  real  time,  and  is  flexible 
enough  to  adapt  to  tiew  situations,  it  is  not 
enough  simply  to  eticode  high-level  tactics 
as  rules  iti  the  system.  Rather,  the  sys¬ 
tem  must  also  undf  rstnnd  why  each  high- 
level  tactical  decision  is  made,  so  it  must 
contain  knowledge  of  the  first  principles 
that  support  those  decisions.  For  example, 
part  of  one  tactic  for  intercepting  a  bogey 
involves  achieving  a  desired  lateral  .sepa¬ 
ration  from  the  bogey’s  flight  path.  One 
way  to  generate  this  behavior  is  to  include 
a  specific  rule  for  the  agent  to  move  to 
the  desired  lateral  separation  when  it  is  on 
the  appropriate  leg  of  the  intercept.  How¬ 
ever.  a  more  intelligc-nt  agent  encodes  the 
knowledge  that  e-xplains  why  this  partic¬ 


ular  tactic  works  (so  that  the  fighter  will 
have  (Mioiigh  space  to  come  around  for  a 
rear-(|uarter  shot  if  the  long  and  medium- 
range  missiles  miss). 

With  the  appropriate  supporting  knowl¬ 
edge.  the  system  can  function  in  situations 
that  the  programmer  may  not  have  an¬ 
ticipated.  .Maintaining  lateral  separation 
from  the  bogey's  flight  path  is  a  general 
principle  that  allows  the  fighter  room  to 
negotiate  a  turn  for  a  short-range  missile 
shot.  This  principle  may  have  an  impact  in 
a  large  number  of  tactical  situations,  and 
therefore  shouldn't  be  considered  as  merely 
an  instruction  to  follow  for  one  particu¬ 
lar  type  of  intercept.  If  the  system  rea¬ 
sons  from  first  principles,  the  programmer 
does  not  have  to  hard  code  every  possible 
contingency,  and  good  variations  on  tactics 
should  emerge  in  response  to  unanticipated 
changes  in  the  simulation  environment. 

Implementing  the  agent  in  this  manner 
also  provides  advantages  in  terms  of  adding 
new  knowledge  to  the  system.  If  the  tacti¬ 
cal  decisions  emerge  from  low-level  knowl¬ 
edge,  high-level  decisions  will  change  ap¬ 
propriately  as  the  supporting  knowledge  is 
changed  or  supplemented.  New  low-level 
knowledge  (such  as  a  better  understand¬ 
ing  of  geometric  principles  or  radar  limita¬ 
tions)  will  interact  with  existing  knowledge 
to  generate  subtle  (or  possibly  dramatic) 
changes  in  behavior.  Thus,  the  agent  can 
reason  in  a  number  of  new  situations  with¬ 
out  requiring  a  new  specific  rule  for  each _ 

ca.se.  The  ease  of  adding  new  knowledge 
to  the  system  also  makes  it  possible  to  in-  ^ 
corporate  existing  machine-learning  mech-  □ 
anisms.  These  can  allow  the  system  to  □ 

adapt  and  improve  its  behavior  with  ex-  - ' 

perience.  as  well  as  provide  insights  into 
how  human  pilots  learn  about  tactics. 
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1  hr  Sii^ir  ;u<  hi tret  lire  lor  |)r<)l)lrni  sul\  iii» 

I  Xrwrl!.  l!)!)())  i>  well  suited  I'oi'  this  ty|)t“ 
ot  l.isk.  It  divides  kiio\vl('du;('  into 
U  III  >1)1111  s  and  allows  i^oals  and  actions 
in  one  problem  space  to  hr-  im|)l('mrnted 
via  rc'asonin”,  in  anotln'r.  I'lius.  when  the 
agent  has  a  liigh  h'Vid  goal  to  int(‘rcept  a 
bogey,  for  ('xamph'.  it  can  switcli  |)roblem 
spac('s  and  reason  about  t  lie  characterist  ics 
of  its  weapons,  radar,  airplane,  and  mili¬ 
tary  doctrine,  din'  knowlerlg<>  from  each 
of  t hes('  space's  combines  to  ge'in'iate  an 
appropriate  tactical  action.  In  turn,  tin' 
high-h'vel  action  <  an  tln'U  be  implemented 
in  a  probh'in  space  that  contains  medium- 
h'vel  knowledge  about  plane  maneuvers  or 
low-level  knowh'dgc'  al)out  moving  t  he  st  ick 
and  flipping  switcln's. 

Because'  knewle'elge'  is  separaleel  inte>  prob¬ 
lem  spacer,  it  e  an  be'  e*asily  upelated.  For 
e.xam[)le'.  if  the'  age'iit's  plane  is  e'epiipped 
with  a  new  raelar  with  a  leinger  range,  only 
the  kneiwle'elge'  in  the*  "radar"  space  ne'e'd 
be  upelated.  Ne'w  ele'e'isieins  maele  in  the 
raelar  space  will  inte'ract  with  the  re'sults 
of  re'aseining  in  eilln'c  problem  spae'es.  even¬ 
tually  irnpae  ting  high-level  ele'cisie^ns  such 
as  which  spe'eific  aetieins  shoulel  be  taken 
to  intercept  a  beige'v.  Idkewise.  if  the  au¬ 
tomat  e'el  agent  is  move'el  to  a  new  simula¬ 
tion  e'tivireinme'iit  with  a  ne'w  interfae'e.  we 
can  appreipriately  u|)e|ate'  the  knowlc'elge  in 
the  "e-ontrol''  preibleun  space,  leaving  the 
re'maining  knowle'elge  intact. 

Simple  tactical  situations 

Our  initial  effort  to  construct  an  intelli¬ 
gent  age'iit  foeuses  em  two  tactical  seenar- 
ie)s  use'el  in  training  jiileits:  the  "non-jinking 
lieige'v"  anei  "l-v-1  aggre'ssive  bogey"  sce¬ 
narios.  In  the  non-jinking  liogey  scenario, 
t fie  target  is  an  airplane  (such  as  a  cargo 


or  fuel  plane')  that  holds  a  steady  course 
and  altitude',  and  doc's  not  carry  any  of- 
fc'iisive  thrc'ats.  1  he  key  to  this  scenario  is 
that  the  bogey  does  not  attempt  to  evade 
(jink)  the  fighter's  attack  in  any  way.  .\l- 
t hough  this  situation  is  not  likely  to  occur 
often  in  real  combat  situations,  it  is  a  valu¬ 
able  training  situation  for  pilots.  It  teaches 
them  how  to  line  up  the  delivery  of  various 
types  of  missiles  when  the  bogey's  behavior 
is  very  predictable.  When  a  non-offensive 
l)ogey's  behavior  becomes  less  predictable, 
the  tactics  reipiired  to  intercept  it  actually 
become  simpler  (but  less  effective). 

Idiere  are  three  main  phases  involved  in 
attacking  a  non-jinking  bogey  (see  Figure 
1 ).  These  involve  delivering  long,  medium, 
and  short-range  missiles.  During  each  of 
the  phases,  the  fighter  must  assume  that 
the  current  missile  will  miss,  and  simul¬ 
taneously  maneuver  into  the  most  advan¬ 
tageous  position  for  the  next  phase.  For 
example,  while  moving  closer  to  the  bogey 
to  fire  a  long-range  missile,  the  fighter  also 
attempts  to  achieve  the  best  lateral  sep¬ 
aration  and  target  aspect  for  a  shot  with 
the  medium-range  missile  (see  Figure  2). 
•After  delivering  a  medium-range  missile, 
the  fighter  must  perform  displacement  and 
counter  turns  in  order  to  end  up  behind 
the  bogey.  I’liis  allows  the  fighter  to  fire 
a  rear-cpiarter  short-range  missile.  Due  to 
these  constraints,  the  fighter  cannot  simply 
head  on  a  collision  course  with  the  bogey, 
but  must  get  to  the  bogey  as  quickly  as 
possible  while  ensuring  that  it  can  eventu¬ 
ally  achieve  a  rear-quarter  missile  shot. 

I'he  tactics  for  executing  this  scenario  are 
relatively  simple.  The  fighter  must  achieve 
t  he  appropriate  lateral  separation  and  tar¬ 
get  asi)ert  while  firing  its  weapons  at  the 
right  times.  Then  it  must  execute  the  dis- 
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I.  LONG-RANGE  MISSILE 


2.  MEDIUM-RANGE  MISSILE 


3.  COUNTERTURN  & 
SHORT-RANGE  MISSILE 


BOGEY 


Figure  1.  Three  stages  for  intercepting  a  non-jinking  bogey. 
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Figure  2.  Definition  of  lateral  separation  and  target  aspect. 
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pliicc'nii'nl  and  countci'  tuiiis  and  dfdivcr 
the  ''liort -ranu;<'  missile.  .\s  mc'ntioned  pn-' 
\  i()nsly.  \V('  fa)uld  ccxh' t  Imse  t  act  ics  dir<‘ct  ly 
into  rules  ior  the  agcuit,  hut  lh(\v  would 
tin'll  only  work  under  very  spc'cific  circum¬ 
stance's  wh('r(' <'V('r\'t hing  goe.s  right,  riuis. 
we  have  impleiiH'nted  the  knowh'dge'  that 
sup()orts  these  tactics.  I'his  knowh'dge  jus¬ 
tifies  ic/i/y  each  tactical  flecision  should  he 
made'  when  it  is  made.  This  allows  the  sys¬ 
tem.  lor  e.xample'.  to  ge't  hack  on  course  feir 
a  short-range  missile  shot  if  it  mis.ses  its 
opportunity  for  the'  medium-range'  missile 
shot  for  some  reasein.  In  aeldition.  any  par¬ 
ticular  action  that  the  agent  generate's  will 
be  haseel  on  t  he' sup|)ort  ing  knowleelge.  and 
the  agent  has  the  potential  to  exjilain  its 
decision  (a  facility  we  plan  to  add  in  the 
future). 

The  1-v-l  aggre'ssive  bogey  scenario  in¬ 
voice's  two  airplane's  with  similar  capabil¬ 
ities.  One  is  prote’e'ting  a  high-value  unit 
and  the  other  is  attempting  to  destroy  it. 
When  t  he  two  fighters  come  in  contact  tlu'v 
both  attempt  to  intere  ept  and  destroy  each 
other,  with  the  ove'rall  goal  of  surviving. 
This  scenario  highlights  an  interaction  be¬ 
tween  elifferent  low-h've'l  constraints  that 
resnlts  in  tactical  ele'cisions.  For  example, 
if  one  fighter  is  e'epTpiped  with  a  slightly 
bette-r  raelar.  missile's  with  leniger  range, 
or  a  nuire  mobile  airplane,  it  elramatically 
affects  the  actions  that  should  be  taken 
in  completing  the  mission  and  surviving. 
Our  agent  .so  far  only  partially  implements 
this  1-v-l  scenario,  anel  it  involves  a  num¬ 
ber  of  issues  that  make  it  more  complex 
than  the  non-jinking  bogey  scenario.  .Af¬ 
ter  eliscussing  the  current  state  of  the  agent 
rnodc'l.  we  will  rfi'seribe  these  issues  in  de- 
t  ail. 


In  ortler  to  construct  an  agent  that  suc¬ 
cessfully  intercepts  a  non-jinking  bogey,  we 
analyzed  tactics  for  the  scenario  and  inter¬ 
viewer!  former  pilots  and  radar  intercept 
officers.  This  allowed  us  to  determine  the 
underlying  knowledge  and  first  principles 
that  support  the  tactics.  Then,  we  en¬ 
coded  this  knowledge  into  an  executable 
Soar  system. 

The  Soar  agent’s  knowledge  is  organized 
into  problem  spaces,  each  containing  oper¬ 
ators  that  allow  the  agent  to  reason  about 
particular  types  of  goals.  When  the  agent 
cannot  immediately  carry  out  an  action  at 
one  level,  it  uses  Soar's  universal  subgoal- 
ing  mechanism  to  move  into  an  alternate 
problem  space  and  consider  methods  for 
carrying  out  that  action.  Therefore,  high- 
level  tactical  decisions  are  eventually  im¬ 
plemented  as  medium-level  maneuver  ac¬ 
tions  or  low-level  control  actions,  and  the 
agent  always  has  multiple  goals  in  memory 
that  it  uses  to  reason  about  and  react  to 
its  ever-changing  situation. 

Depending  on  the  particular  simulation 
platform,  the  current  Soar  agent  requires 
between  1.3  and  17  problem  spaces  to  rea¬ 
son  with;  i.e..  13-17  different  types  of  goals 
that  it  reasons  about.  Most  of  these  are 
shown  in  Figure  3.  The  mission,  protect- 
hvu.  barcap,  and  intercept  problem  spaces 
encode  tactical  knowledge  for  carrying  out 
missions  and  performing  intercepts.  The 
problem  spaces  for  weapons  and  missiles 
include  knowledge  about  specific  w’eapons 
and  the  actions  that  must  be  performed 
to  deliver  them  to  a  target.  The  maneu¬ 
ver  and  absolutes  problem  spaces  deter¬ 
mine  the  actual  plane  maneuvers  that  must 
be  carried  out  to  implement  higher-level 
actions.  The  remaining  problem  spaces  im- 
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Figure  3.  Soar’s  problem  spaces  for  intercepting  a  non-jinking  bogey. 


|)l(’inrn!  airpldnc  iii.incuv cis  at  xaritai" 
cls  (it  ''pccificat  ion.  down  to  tlio  Icxcl  ol 
st  ick  and  l)nt  ton  coinniands  t  hat  arc'  is''n<'(l 
to  t  he  tli”lit  sininlator. 

.\l  any  ))art icnlar  instant,  l)('t wa-i'n  d  and 
12  prohicin  sjiacc''  (or  hii'rarcliical  »oalsi 
arc  nsnally  active.  I  hns.  when  changes  oc¬ 
cur  in  th('  asicnt's  "itnation.  there  ar('  mul¬ 
tiple  levels  at  which  tin'  a‘j,('nt  may  ri'act 
([’('arson  et  ah.  101)2).  l-'or  example,  at  a 
hrw  h'vel.  a  sudden  down  draft  can  cause 
a  chan(^('  in  climli-ratc'  or  altitmh'.  lead 
ing  th('  ag('nt  dirc'ctly  to  pnll  hack  on  tiu' 
stick.  .\t  a  hi!i;h('r  h'va'l.  a  manenv('r  hy  a 
l)ojf<'y  on  th(’  radar  can  cans('  a  change  in 
tactics.  .Any  reasoning  involved  in  imple- 
nn'iiting  the  ik'w  tactical  (h'cision  also  p<'r- 
colates  down  to  a  ik'w  maiK'tiver  or  stick 
action.  In  this  maimer.  Soar  maintains  its 
varii'ty  of  goals  in  parallel,  and  violations 
of  the  goals  at  anv  level  h'ad  to  imtnediate 
action  at  the  appropriate'  level. 

\V('  have  implemented  ati  initial  inod<'l  for 
the  turn- jinkitig  hiK^ey  scenario  in  whole' or 
in  part  on  thre'e  se'parate'  flight  simulators, 
riie  simplest  simulator  move's  plane's  in  a 
t wo-dime'iisional  u.rid- world.  In  addition, 
the'  plane's  do  not  move  with  re'alistic  Hight 
dynamics.  W’e  nsc'd  this  .simulator  to  [ero- 
totype' t  h('  syste'm  and  de'hng  t  he'  high-le'vel 
tactics  ('mhe'dfle'd  in  the'  system.  I  he'  sec¬ 
ond  flight  sininlator  was  adapt e'd  from  the' 
flight  simulator  provided  with  S(Ji  graph¬ 
ics  workstat ie?ns.  It  works  in  re'al  time  and 
requirc's  the  agent  to  issne  very  low  level 
commands  at  the'  le've'l  of  moving  the  stie  k 
(by  issuing  mouse  jiixel  moveme'uts)  and 
other  low-|ev('l  commands  (by  simulating 
ke'vboard  pre'sse's).  1  he'  non-jinking  bogey 
sce'iiario  has  not  \('t  been  comph'te'ly  im- 
[ile'ine'iiteel  on  this  simulator,  be’caiise  Soar 
must  handle  t  he'  low  leve'l  int  ricacie's  of  sini 


ply  Hying  the'  airplane'  as  we'll  as  worrvitig 
about  tactical  de'cisions  and  maneuvering, 
[■'iiially.  w('  have'  imple'ine'nte'd  the  scenario 
on  BB.N's  .ModS.Ah'  simulator,  which  has 
the  most  realistic  flight  dynamics  of  the 
thre'e  simulators.  I  his  simulator  works  in 
real  time'  (with  a  scheduler  elividing  time' 
be'twe'en  the  simulation  and  agents)  and  it 
take's  commands  at  the'  level  of  mane’uver 
actions  (such  as  eh'sire'd  heading  and  alti- 
tude'i  without  making  the  agent  concern 
itM'll  with  how  the  maneuvers  are  actually 
impli'inente'd  with  airplane  controls. 

.X-'  of  now,  we  have  not  completely  de'- 
velopeei  the  knowledge  base  that  would  al¬ 
low  our  agent  to  successfully  fly  the  1-v- 
I  aggre'ssive  bogey  scenario,  ddiis  scenario 
diffe'rs  from  the  non-jinking  bogey  scenario 
along  two  major  dimensions.  First,  the  bo- 
ge'V  maneuvers,  so  its  behavior  is  not  en¬ 
tirely  predictable.  Second,  the  bogey  is  ag¬ 
gressive  and  has  ofTensive  capabilities,  so 
any  action  that  is  taken  must  also  addre'ss 
t  he  overall  goal  of  surviving:  the  agent  can¬ 
not  simply  close  in  on  the  bogey  and  shoot 
it. 

In  order  to  successfully  cemiplete  a  mis¬ 
sion  against  an  aggressive  bogey,  the  agent 
must  include  not  only  extra  knowledge  in 
its  tactical  problem  spaces,  but  it  must  also 
have'  two  new  capabilities  to  address  the 
above'  issues.  First,  the  agent  must  be  able 
to  inte'rpre't  and  as.sess  its  current  situation 
at  all  (or  at  le'ast  most)  times.  This  primar¬ 
ily  involves  inter{)ret ing  the  bogey's  cur- 
K'nl  aetions  and  preelicting  its  future  ac¬ 
tions.  .\s  with  most  of  the  agent's  rf'a,son- 
ing.  the'  interpretation  proce'ss  akso  takes 
place'  at  multiple  levels.  .At  a  low'  level, 
the'  fighte'r  must  re'cognize  when  the  bogey 
has  initiate'd  a  turn  and  wdien  it  has  com- 
l>le'te'd  one.  .At  a  higher  level,  the  fighte'r 


must  (h'tc'rmiiK'  whet  her  the  turn  iiidiciitcs 
soiiu'  kind  of  threat,  and  what  that  thri'at 
tnay  he.  I'or  exainph'.  if  tlu-  l)oij,('v  initially 
eoines  to  a  collision  course'  with  tlu'  iighte-r. 
this  |)rol)al)ly  indicate's  that  the  hogey  is 
aggressive  and  is  goitig  to  try  to  shoot  the 
fighter.  If  the  hogey  points  towaials  the 
fighter  and  then  make's  a  hard  tnrn.  this 
irulictite's  that  the  hergey  has  probably  just 
fired  a  missile.  I  he  age'iit  must  int('r|)rel 
the  limite'd  iid'ormation  it  gets  from  its  sen¬ 
sors.  riu'n  it  must  use'  this  inte'r|)retatie)n 
to  pre'elict  the  goals  that  the  be^gey  is  try¬ 
ing  te)  achieve'  and  the'  actions  at  difFerent 
levels  that  the  troge'V  is  carrying  out. 

Ihe'  se'cond  nece'ssary  capability  for  the 
age'iit  is  to  use  multi[)le  high-level  goals  to 
constrain  the  actions  that  the  agent  gener- 
ate's.  These  types  of  goals  are  a  bit  eliffer- 
e'lit  From  the  paralle'l  goals  that  the  Soar 
age'nt  already  handle's,  because  they  are 
not  hierarchical  in  nature'.  Rather,  they 
are'  distinct  goals  that  interact  with  each 
othe-r.  I'or  e'xam|)le'  one  goal,  dfstroi/  bo- 
(Jill,  implies  that  the  fighter  should  close  in 
e)n  the'  beigey  as  epiickly  as  possible.  IIow- 
eve'r.  another  goal,  surrin.  pressures  the 
fight e'r  to  avoid  the  bogey  in  order  to  stay 
out  of  the*  Irogey's  weapon  range.  These 
ce)nflie  t ing  goals  both  must  be  used  to  se¬ 
lect  from  multiple'  pe)ssible  actions.  This 
type'  of  re'ase)ning  h'aels  directly  to  e'om- 
pe)site  tactical  actions.  For  example,  the 
fighte'r  may  get  close’  e'liough  to  fire  a  mis¬ 
sile  and  then  make  a  sudelen  hard  turn. 
The'  turn  must  be  harel  enough  to  keep  the 
be)ge'y  and  fighte'r  from  getting  close  te)o 
epiieklw  but  not  se)  harel  that  the*  fighte’r 
lose’s  its  raeiar  keek  on  the  boge’v  (which 
wejidel  put  the'  fiirlitei'  at  a  large'  disaelvan- 
tage'l.  In  this  manne'r.  the  a'gent  ek'ter- 
mine's  the'  bf'st  aetion  that  supports  twe) 
simultane’eeus.  eoidlie  t ing  ge)als. 


Ihe'  issue's  of  inte'r|»re'tat  ieeii  and  simulta- 
ne'oiis  goals  are'  not  trivial,  anel  t  he'y  pla\ 
e-e'iitral  role's  in  age'iit  re'asoning  fe)r  any  tae - 
tical  situations  e'xcept  the'  simplest  one's. 
Much  of  tactical  decision  tnaking  involves 
ere’ating  a  mode'l  of  the  world  from  lim- 
ite’d  information  and  addressing  multiple 
goals  and  eonstraints.  such  as  the  current 
mission,  survival,  and  the  characteristics 
anel  status  of  the  we’apons  and  airplane. 
We'  have'  not  completed  the  incorporation 
e)f  this  knowledge'  into  tfie  agent  yet.  but 
we-  are'  taking  advantage  of  the  strengths 
e>f  the  Soar  architecture  in  order  to  irn- 
ple  inent  the.se  two  important  capabilities 
( ( 'eevrigaru,  1!)92). 

Discussion 

We  have  implemented  an  intelligent,  au¬ 
tonomous  agent  that  completes  missions  in 
a  simple  tactical  scenario.  The  agent  is 
designed  with  flexibility  in  mind.  It  rea¬ 
sons  from  first  principles  about  high-level 
tactical  decisions,  and  is  thus  able  to  rea¬ 
son  in  unexpected  situations  and  recover 
gracefully  from  mistakes.  In  addition,  the 
agent's  knowledge  base  is  flexible  enough 
to  be  easily  transferred  between  simulation 
platforms  and  to  encode  new  tactics  in  a 
modular  fashion.  We  are  currently  imple- 
UK'iiting  the  knowledge  necessary  for  the 
ag('nt  to  complete  the  1-v-l  aggressive  bo¬ 
gey  scenario.  This  includes  addressing  the 
two  important  issues  of  situation  interpre¬ 
tation  and  achieving  multiple  simultaneous 
and  interacting  goals. 

Our  future  research  will  involve  incremen¬ 
tally  expanding  the  agent's  knowledge  base 
so  it  can  reason  robustly  in  a  wide  range 
of  1-v-l  scenarios.  We  will  also  soon  fo¬ 
cus  on  modeling  more  complex  scenarios, 
including  those  involving  more  than  two 


plaiK's.  riiis  will  also  allow  us  to  oxpaiul 
tlio  agent's  coverago  of  the  rogiiitivo  ho- 
haviors  involved  in  tactical  flight.  For  e.\- 
ample.  we  will  incorporate  more  intelligent 
methods  for  situation  assessment,  model¬ 
ing  other  agents  (i.e..  rohnstly  predicting 
actions  and  goals  of  other  participants  in 
the  scenario,  both  friends  and  foes),  iden¬ 
tifying  potential  threats,  and  reacting  to 
them.  Beyond  that,  we  will  focus  on  more 
complex  cognitive  tasks,  such  as  more  com¬ 
plete  integration  of  planning,  reaction,  and 
execution,  more  sophisticated  interpreta¬ 
tion  of  the  environment  and  other  agents, 
and  learning  from  instruction. 
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